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ABSTRACT 

Changes  in  atmospheric  conditions  and  sensor  response  for  successive  imaging  sessions  have  limited  the 
use  of  fixed  target  hyperspectral  libraries,  especially  for  multiple  mission  studies,  to  help  identify  and  discriminate 
targets  from  cluttered  backgrounds.  The  hyperspectral  target  signature  instability  has  resulted  in  a  dependence  on 
anomaly  detection  algorithms  in  real  time  surveillance  applications.  These  algorithms  fail  to  meet  some  critical 
military  requirements.  This  study  examines  a  variety  of  mathematical  transforms  of  the  spectral  signatures  derived 
from  missions  flown  on  different  days  with  starkly  different  weather  conditions.  The  transforms  use  overlapping 
regions  in  the  two  data  sets  but  avoid  registering  the  image  cubes.  Some  of  the  transforms  use  statistical  features 
such  as  auto  covariance  matrices,  means,  and/or  standard  deviations  of  the  image  cubes.  Other  algorithms  use 
spectral  means  taken  from  common  features  in  the  image  cubes  such  as  trees,  roads,  or  blackbodies  in  both  image 
cubes.  Our  study  examines  target  spectra  transformations  in  the  long-wave  infrared  spectra  of  man-made  targets  and 
natural  backgrounds  obtained  with  the  SEBASS  (8-12  pm)  imager  as  part  of  the  Dark  HORSE  2  exercise  during  the 
HYDRA  data  collection  in  November,  1998.  This  study  computes  the  signal  to  clutter  ratio  (SCR)  for  transforms 
that  required  high  accuracy  registration,  various  spectral  signature  transformations  that  do  not  need  any  registration, 
and  those  transforms  that  used  random,  varying  number  of  pixels  in  the  overlap  area.  The  transformed  signatures 
were  subsequently  used  in  matched  filter  searches  to  successfully  find  targets  with  low  false  alarm  rates  (<  1 
FA/Km2).  Transforms  that  use  covariance  matrices  from  the  image  cubes  achieve  significantly  higher  performance 
relative  to  those  algorithms  that  use  spectral  libraries  of  common  features  in  the  image  cubes  or  rely  on  the  image 
cube  means.  However,  transforms  that  use  covariance  matrices  (rather  than  image  cube  means  or  spectral  libraries) 
require  greater  overlap  in  the  area  coverage  of  the  two  image  cubes  to  achieve  maximal  SCR.  Mathematically 
transformed  spectral  signatures  can  dramatically  improve  detection  performance. 
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1.  INTRODUCTION 


Recently  [1]  there  has  been  interest  in  using  multiple  missions  over  extended  time  periods  to  remotely  detect  targets. 
Spectral  signatures  derived  from  a  multispectral  or  hyperspectral  imager  can  be  used  in  matched  filter  algorithms  to 
help  discriminate  targets  from  cluttered  backgrounds.  Unfortunately,  a  given  spectral  signature  may  not  remain 
stable  during  subsequent  flight  missions  due  to  changes  in  atmospheric  conditions  and  sensor  response  [2-3],  thus 
limiting  target  detection  using  a  matched  filter  algorithm.  This  study  mathematically  transformed  spectral  signatures 
from  one  day  to  another  and  then  used  these  transformed  signatures  in  matched  filter  searches  for  targets. 

Previous  studies  [2], [3]  examined  the  evolution  of  the  spectral  signatures  over  several  missions.  This  earlier  work 
found  that  data  collected  on  a  given  day  were  stable  and  required  no  additional  corrections.  Spectral  signatures,  for 
subsequent  days,  changed  more  due  to  changes  in  atmospheric  conditions  and  sensor  response.  Image-based 
corrections  of  the  spectral  signatures  performed  better  than  those  based  solely  on  atmospheric  corrections.  Image 
based  corrections  accounted  for  the  effects  of  the  changes  of  the  atmosphere  and  sensor  response  on  the  spectra 
between  missions.  The  best  image-based  correction,  known  as  chronochrome  [4],  is  derived  from  minimizing  errors 
from  a  linear  scaling  matrix  but  requires  sub-pixel  registration.  Registration  of  image  cubes,  difficult  under  the  best 
conditions,  is  further  complicated  by  the  presence  of  uncorrected  roll,  and  the  inability  to  fly  multiple  missions  that 
exactly  track  each  other. 

Earlier  studies  addressed  some  of  the  issues  examined  in  this  work.  Considerable  effort  has  been  devoted  to 
correcting  for  the  intervening  atmosphere  between  the  remote  sensor  and  the  ground.  For  example,  scene  spectra 
have  been  normalized  using  an  average-scene  spectrum  [5],  using  calibration  panels  in  the  scene  (“empirical  line 
method”)  [6],  or  using  spectral  features  in  the  scene  to  autonomously  search  for  specific  objects  such  as  green 
vegetation  or  blackbodies  [7],  Alternatively,  narrow  detected  features  in  the  spectrum  have  been  used  to  infer  the 
integrated  water  amount  within  each  pixel  to  deduce  the  content  of  other  attenuating  molecules  and  aerosols  and  to 
compute  the  scattering  and  transmittance  of  radiation  [8],  Another  approach  uses  a  vast  library  of  atmospheric 
conditions  to  account  for  changes  in  upwelling  and  transmittance,  and  then  shrink  the  vast  array  of  possible 
solutions  to  a  smaller  subspace  of  atmospheric  conditions  to  help  transform  spectral  signatures  [9], 

Other  workers  have  focused  on  methods  to  approximate  the  autocovariance  matrix  to  help  identify  objects  and 
classify  the  image  set.  For  example,  as  part  of  an  effort  to  develop  an  adaptive  anomaly  detector,  earlier  studies  [10] 
exploited  information  on  the  spatial  and  spectral  correlation  in  the  data  set  to  help  model  the  clutter  and  approximate 
the  autocovariance  matrix  using  only  a  few  parameters.  The  problem  of  limited  training  data  and  approximations  to 
the  covariance  matrix  has  also  been  examined.  Previous  investigators  [11-13]  reduced  the  number  of  pixels  in  the 
image  cubes  and  approximated  the  auto-covariance  matrix  so  as  to  avoid  problems  involving  matrix  singularity 
issues  and  to  help  segment  the  image  set. 

The  present  work  examines  the  ability  to  mathematically  transform  spectral  signatures  of  targets  viewed  during 
multi -temporal  monitoring  studies  (Figure  1).  The  goal  is  to  develop  and  test  algorithms  that  do  not  require 
registration  between  the  image  cubes.  Our  primary  interest  lies  in  studying  the  effectiveness  of  a  variety  of  methods 
in  improving  target  detection  capabilities.  These  new  transforms  convert  target  signatures  from  one  day  to  another 
day  and  use  these  altered  signatures  in  matched  filter  searches.  The  transformed  signatures  were  compared  with 
those  signatures  converted  with  the  chronochrome  transform  and  with  the  unchanged  in-scene  signature.  The  new 
transforms  approximate  the  cross-covariance  matrix,  the  only  component  in  the  chronochrome  algorithm  that 
depends  on  registration.  All  transforms  were  tested  in  terms  of  stability  and  ability  to  detect  targets  by  varying  the 
number  of  randomly  sampled  pixels  in  the  “Target”  image  cube.  These  transforms  were  examined  by  comparing 
ROC  curves  (plots  of  the  probability  of  target  detection  versus  false  alarm  rate)  using  the  converted  target  spectra 
for  the  matched  filter  algorithm. 


2.  SENSOR  AND  MISSION  DESCRIPTION 

The  Dark  HORSE  2  collection  [14],  which  used  the  SEBASS  sensor  from  Aerospace  Corporation  [15],  flew  on  a 
Twin  Otter  airplane  over  Eglin  Air  Force  base  and  imaged  a  set  of  prescribed  scenarios  with  man-made  targets  and 
backgrounds  composed  of  trees  and  roads.  This  study  focuses  on  the  data  collected  over  three  consecutive  days 
(November  10,  1 1, 12, 1998).  The  SEBASS  LWIR  (long  wave  infrared  radiation)  sensor  responds  to  thermal 


2 


Figure  1.  Schematic  figure  of  multiple  missions  of  remote  hyperspectral  imager 
and  associated  overlapping  regions. 

Registration  between  sets  of  missions  means  geometrically  orienting  and  aligning 
each  pixel  in  both  missions. 
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radiation  in  the  7.8-13.4  micron  region.  The  data  were  collected  with  a  focal  plane  array  (FPA)  using  8  DSP 
digitizers  (SHARC).  The  slit  is  180  um  wide  and  the  optics  between  the  slit  and  the  FPA  is  arranged  such  that  the 
image  of  the  slit  at  the  position  of  the  FPA  matches  the  pixel  size  of  75  pm..  The  data  were  collected  using  the  push 
broom  technique  at  a  nominal  30  Hz  rate.  The  plane  carrying  the  sensor  flew  at  an  elevation  of  approximately  850 
meters  above  the  targets.  The  hyperspectra!  data  were  acquired  approximately  once  per  pass  during  data  runs  (about 
every  6-10  min).  In  addition,  flat  field  calibrations  (intensity  corrections  at  pixel  level  for  the  FPA  using  blackbody 
sources  of  LWIR  radiation)  were  applied  to  the  hyperspectral  data  and  taken  just  prior  (within  10  min,  sometimes 
less)  to  the  run.  The  imager  was  flat-fielded  using  temperature  sources  of  approximately  20  and  40  C.  Following 
spectral  and  spatial  edge  editing,  the  image  cubes  were  binned  to  30  bands  spanning  the  LWIR  range,  with  a  cross 
track  size  of  128  pixels,  and  variable  track  length. 

3.  TRANSFORMATIONS:  APPROXIMATIONS  TO  CHRONOCHROME 


This  study  examines  transformations  of  three  dimensional  image  cubes  composed  of  two-dimensional  spatial  arrays 
(labeled  with  a  single  subscript  k)  and  the  other  dimension  associated  with  wavelength  (labeled  with  superscript 
index  i).  The  chronochrome  algorithm  [4]  uses  a  matrix  C  which  is  constructed  so  that  the  predictor  C  minimizes 
the  mean  squared  error.  Specifically,  C  can  transform  a  given  spectral  signature  or  image  cube  to  another  spectral 
signature  or  image  cube  x2  relative  to  their  respective  mean  values  i.e. 

^2,k  "  ^  2,mean~~  ^21  (^l,k  ”  ^l,mean  )  (3.1) 
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Registration  between  image  cubes  Xj  and  x2  is  needed  to  compute  the  cross  correlation  R2i.  The  missions  were 
registered  using  common  tiepoints  in  the  image  cubes  under  study.  Spectral  signature  Lj  from  mission  1  is 
transformed  to  another  spectral  library  appropriate  L^tnms  for  the  conditions  in  mission  2  via 
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This  study  examined  a  variety  of  approximations  to  the  cross  covariance  R2j  that  did  not  require  registration:  using 
the  auto  covariance  associated  only  with  mission  2  or  R22  and  the  auto  covariance  associated  only  with  mission  1  or 
Rn  and  standard  deviations  Cj,  o2  where 


o[=i^i{xi~-xiKmean}\h  =  \,7 
\  N  —  1  k=l 

and  means  xh-mean  of  individual  data  sets. 

3.1  Observations  and  Goals 


(3.8) 
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This  study  investigated  a  wide  variety  of  transforms.  However,  this  paper  only  discusses  a  small  subset  of 
algorithms,  namely  those  that  yielded  the  highest  target  detection  for  constant  false  alarm  rate.  This  study  only 
examines  calibrated  data  sets.  Transforms  that  yield  the  best  target  detection  for  this  particular  data  set,  may  not 
work  in  other  situations  such  as  those  that  are  not  gain  corrected.  The  study  assumes  that  only  atmospheric  or  sensor 
changes  between  mission  determine  the  spectral  transforms.  In  other  words,  the  transforms  under  discission  assume 
that  missions  can  be  connected  to  each  other  through  a  simple  relationship  between  pairs  of  bands  (see  .Section  3.3), 
rather  than  coupling  a  given  band  to  the  entire  set  of  band. 

A  goal  for  this  study  was  to  approximate  the  cross  covariance  matrix  R2]  using  data  taken  from  two  image  cubes, 
without  having  to  register  them.  Figure  2a  displays  a  row  (seventh  band  corresponding  to  X=9.096  microns)  the 
chronochrome  cross-covariance  matrix,  or  R2J;  the  equivalent  row  for  the  auto-covariance  for  the  ‘  hazy  day”,  or 
“Bkg-Bkg  CV“  matrix,  or  Rn;  the  equivalent  row  for  the  auto  covariance  for  the  “In-scene”  image  cube  or  “Trg-Trg 
CV“,  or  R22- 


The  ensuing  sections  discuss  the  symmetries  of  the  approximated  transforms,  and  supply  plausibility  arguments  in 
support  of  examining  the  proposed  transforms  rather  than  rigorous  derivations.  Signal  to  clutter  calculations  and 
target  detection  probability  for  a  given  false  alarm  rate  (following  matched  filter  searches  using  transformed 
signatures)  provide  the  quantitative  comparisons  of  the  transforms  in  this  study  for  the  particular  scenario  studied. 

3.2  Symmetries 

The  chronochrome  algorithm  uses  the  cross  covariance  matrix  R2]  and  a  predictor  C2i  to  help  transform  spectral 
signatures.  Under  “time  reversal”  or  interchange  of  the  labels  for  the  missions  l*->2,  the  cross  covariance  R2J  and 
predictor  C2i  respond  in  certain  ways.  Approximations  to  the  chronochrome  algorithm,  however,  may  or  may  not 
obey  the  same  symmetries  as  the  chronochrome.  This  study  examined  the  approximated  transform  symmetry  and 
correlated  the  ability  of  the  transform  to  discriminate  targets  from  backgrounds.  From  inspection,  the  cross 
covariance  obeys  the  following  symmetry  namely 

Rij  -Rji 

^21  a12 

(3.9) 

and  the  auto  covariance  matrices  obey  the  following  symmetries 

R?i  =  Rft  (3.10) 

and 

R&=R&  (3.1D 

In  addition,  if  e'J=0,  then  chronochrome  predictor  C21  follows 

(3-12) 


where 

Cu  =X  *«'"(* ilr  (3.13) 

m 

If  however  e^O,  then 

cl  ^(c;4)-’  (3.i4) 

A  variety  of  approximations  to  R2i  were  proposed  and  tested.  Table  1  lists  the  approximations  to  R2i.  The  behavior 
of  the  approximate  transforms  under  interchange  of  missions  1  and  2  are  also  listed. 
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Table  1 

List  of  Approximations  to  Chronochrome  and 
Symmetries 


R2I 

Approximation 

Type 

R21 

R2iij=  Ri2ji 

C2,ij=  (C,/)'1 

Chronochrome 

r2.1j 

Yes 

No 

Average  CV 

0.5{Ru1j+R221j} 

Yes 

No 

Weighted  CV 

0.5cijc2'  {(Rii1J/Oi'aiJ )+  R22y/a2‘a2J } 

Yes 

No 

Target  CV 

OiJa2‘{  R221J/a2’c2J } 

No 

Yes 

Diagonal 

oiJa2'{  Rn1J/ai’aiJ ) 

No 

Yes 
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3.3  Motivation  for  “diagonal”  and  “target”  transform  approximations  to  chronochrome 


As  a  first  approximation,  suppose  each  pixel  within  image  cubes  1  and  2  are  related  to  each  other  simply  as 


X2,k  X2,mean 


=  bi(xh 


through  a  coupling  coefficient  bk‘  .  This  coupling  coefficient  can  depend  on  the  change  in  the  intervening 
atmosphere  transmission  and  changing  sensor  response  between  the  two  missions.  Further,  suppose  bk‘  only  depends 
on  the  wavelength  or  band  number  i,  independent  of  pixel  location  k  (i.e.  image  cubes  have  been  flat-fielded,  no 
clouds  within  images).  Then 

*21  *  77  -X\,mean)(Xlk  ~  X{ .mean)  =  b> R11  (3.16) 

N  k= 1 

and  similarly 

-xLeaJ2  =(b‘)  (3-17) 

V  N  - 1  k=\ 

After  substituting  for  V  and  rearranging  terms,  the  “background  CV”  or  “diagonal”  transform  refers  to  the  following 
expression 


4^/CT'- 


ii_-  D‘J 


If  the  quantities  Rn,  R22,  Oi,  c2  are  directly  taken  from  the  image  sets,  then  “time  reversal”  symmetry  for  the  cross 
covariance  R2i  (i.e.  R2{ij  *Ri2ji )  is  not  obeyed  for  the  “diagonal”  transform  approximation.  The  latter  approximation 
is  referred  to  as  “diagonal”  because  the  approximate  full  chronochrome  predictor  C2i  is  then  given  by  a  diagonal 


The  predictor  C2i  for  the  “diagonal”  transform  obeys  C2iu=  (Ci21J)’  • 

The  “diagonal”  approximation  is  only  one  way  to  couple  the  image  sets  through  a  linear  scaling  coefficient.  Another 
transform  that  strongly  resembles  the  “diagonal”  transform  can  be  considered.  In  a  similar  fashion  used  in 
motivating  the  “diagonal”  transform,  suppose  each  pixel  within  image  cubes  1  and  2  are  related  to  each  other 

Xik  -  XLean  *  (■ Xik  ~  XL,ean  )  (3  -20) 

K 

through  a  coupling  coefficient  the  inverse  bkj .  Again,  suppose  bkj  only  depends  on  the  wavelength  or  band  number  j, 
independent  of  pixel  location  k.  Then 

.  1  ]V  J  1 

*21  *  T7  lT7(Xk  -Xl,mearXXlk  ~ Xlmean)  =  ~J Rll  (3.21) 

N  k=\bJ  bJ 

and  similarly 


W  «  J-k-I(T-)2K*  ~XLean}2  =  (A)  °i  0-22) 

V  N  -1  bJ  bJ 

After  substituting  for  b*  and  rearranging  terms,  the  “target  CV”  transform  refers  to  the  following  expression 


=  Ro¬ 


under  “time  reversal”,  the  predictor  associated  with  the  “target  CV”  transform  follows  C2]=(C|2)' . 
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3.4  Motivation  for  “weighted  CV”  Transform 


The  “diagonal”  and  the  “target  CV”  transforms  assume  that  the  image  cubes  for  missions  1  and  2  are  connected  to 
each  other  through  a  coupling  coefficient,  independent  of  position  in  the  image.  Thus,  both  approximated  transforms 
do  not  follow  the  expected  behavior  of  the  exact  chronochrome  algorithm  under  interchange  of  labels  1  and  2. 
“W  righted  CV”  is  a  symmetrized  combination  of  the  “diagonal”  and  “target  CV”  transforms  i.e. 


pv 

4  -er.'a  (.5^ 

<7.07 


+  .5- 


nij 

n21  \ 
i  ' 


(3.24) 


The  item  inside  the  parenthesis  may  be  interpreted  as  an  average  of  the  correlation  coefficients  for  missions  1  and  2. 
Interchange  of  mission  labels  1  and  2  for  the  “weighted  CV”  version  of  R2J,j  results  in  R2i,j=Ri2J1  and  the  predictor 
C2i*(C12)'1.  The  “weighted  CV”  transform  matches  the  symmetry  of  the  chronochrome  transform  under  interchange 
of  labels  1  and  2. 


3.5  Motivation  for  “average  CV”  Transform 

This  study  simulates  the  Chronochrome  predictor  C2]  through  approximating  the  cross  covariance  matrix  R2].  If  the 
overlap  regions  within  data  sets  1  and  2  are  calibrated  and  have  not  changed  substantively  then  it  may  be  possible  to 
examine  to  assume  that  ai=a2  for  all  spectral  components,  then  the  “weighted  CV”  simplifies  to  the  “average  CV” 
or 

*£=.5(4+4)  (3-25) 


Figure  2a  shows  that  a  row  in  the  cross  covariance  R2]  matrix  lies  between  the  appropriate  rows  in  the  auto 
covariance  matrices  Rn  and  R22.  The  “average  CV”  transform  matches  the  symmetry  of  the  chronochrome 
transform  under  interchange  of  labels  1  and  2.  In  addition,  the  approximation  to  R2\  obeys  an  additional  symmetry 
namely  and  C?i  *  Cjf1. 


4.  Transformations:  Background  Spectral  Features:  Scaling  and  Offset  Transforms 


4.1  Scaling-based  Techniques 


This  study  also  examined  simpler  approaches  that  did  not  require  minimizing  the  predicted  error.  Instead,  it  is 
assumed  that  a  particular  “typical”  or  “representative”  feature,  identified  and  detected  in  both  image  cubes,  provides 
a  valid  indicator  of  changes  for  all  pixels  in  the  overlap  region.  The  alternative  approach  for  predicting  spectral 
signatures  assumes  that  differences  in  the  image  sets  may  be  due  to  changes  in  atmospheric  transmission  and/or 
sensor  response,  but  does  not  depend  on  pixel  position.  In  addition,  it  is  further  assumed  that  the  predictor  is 
diagonal  and  changes  in  the  spectra  follow  a  scaling  type  of  transform 

(4, k  ~ X2,mean )  “  -Ximean)  (4-1) 


Equation  4.1  is  identical  to  equation  3.15  but  different  labeling  is  used  to  help  distinguish  the  two  very  different 
approaches  for  transforming  the  target  spectra.  This  study  instead  uses  common  features,  identified  by  the  image 
analyst  in  the  two  sets  such  as  trees  or  sandy  roads  or  automatically  identifies  “blackbodies”  using  the  ISAC 
algorithm  [15]  or  computes  the  means  in  the  two  image  sets.  In  other  words,  the  average  spectrum  XAve_sPect  for 
trees,  or  sandy  roads,  or  blackbodies  are  substituted  for  x2>kl  and  Xj(k\ 


^2 ,Ave_Spect  ^2 .mean  ~  ^  (*^1  ,Ave_Specl 


-X 


1  ,mean 


) 


(4.2) 


where  X  1  Ave_spec  is  the  average  spectrum  X  Avc_spect  for  the  trees,  sandy  road,  blackbody.  The  full  approximate 
chronochrome  predictor  is  diagonal  and  given  by 


Cu  - 


V f  _  Y» 

^  2,Ave  _Spect  '*2, mean 

y*  _  *7 

^  1 ,  A  ve  _  Sped  1 , mean 


(4.3) 
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Presumably  the  common  features  (trees,  sandy  roads,  blackbodies)  follow  the  median  values  of  image  cubes  i.e. 
Yxiocx1  (4.4) 

k 

and  so  the  predictor  can  be  further  simplified  as 


Cij  = 


Y* 

^2  ,Ave_ 


Sped 


K 


*# 


Avc  _  Sped 


(4.5) 


The  latter  expression  for  the  predictor  depends  solely  on  the  average  spectra  and  does  not  contain  any  explicit 
information  regarding  the  statistics  of  the  image  cubes.  This  expression  is  similar  to  the  automatic  scene-adaptive 
techniques  used  in  ERIM  algorithm  [16]  for  transforming  spectral  image  libraries. 


The  scaling  predictions  and  approximations  Clj  are  used  to  transform  the  spectra  Li  of  a  target  taken  from  the  initial 
image  cube  (in  this  study,  “hazy  day”  image  cube)  to  the  transformed  target  spectra  Imrans  to  be  used  in  the  matched 
filter  search. 


^2 ,trans  ~  C  X\,mean)  +  X2,mean 


(4.6) 


4.2  Offset-based  Techniques: 


Instead  of  using  the  scaling  transformation  to  predict  changes  in  the  two  image  cubes  (such  as  in  the  chronochrome 
approach),  this  study  also  examined  offset  vectors.  The  offset  mapping  follows 


(*h  -  ^2, mean  )  »  (*U  “  XLean  )  +  B'  ^ 

Applying  the  same  considerations,  assumptions,  and  substitutions  used  in  the  simplified  scaling  approach,  namely 
assuming  that  a  “typical”  spectral  feature  X  Ave_Spect  (identified  by  an  image  analyst  or  automatically  detected)  the 
offset  predictor  B'  follows 

B  =  (-^2  ,Ave  _Spect  ~  Xl,mean}~  (^l,Ave  _Spect  ~  X\,mean)  (4-8) 

Common  background  objects  in  the  scene  (X  Ave_sPect  such  as  trees,  sandy  road,  “blackbodies”)  are  used  to  convert 
the  target  spectral  signature  through  an  offset  correction  i.e. 


kjjrans  2,Ave  ^Spect  ,Ave _Spect') 

This  correction  is  then  applied  to  all  spectra  under  study  and  is  labeled  as  Offset. 


(4.9) 


5.  MISSION  SUMMARY 

The  missions  were  flown  at  night  (Day  3  or  “Target”  or  “In-Scene”  or  Mission  3,  shot  #27  according  to  [14] 
nomenclature)  and  early  dawn  (Day  1  or  Background  or  “Hazy  Day”  or  Mission  5,  shot  #13  according  to  [14] 
nomenclature).  The  relative  humidity  varied  from  to  100%  (Day  1)  to  85%  (Day  3).  The  air  temperature  ranged 
from  14.5  C  (Day  1)  to  5.5  C  (Day  3).  The  image  data  were  collected  at  an  elevation  of  850  meters  and  the  sensor 
was  oriented  in  the  nadir  direction.  The  target  mission  was  flown  in  the  easterly  direction  while  the  background  was 
flown  in  the  northerly  direction.  The  overlapping  region  was  small  relative  to  the  entire  data  set.  For  the 
chronochrome  transform,  the  images  were  linearly  rotated,  translated,  and  resampled  and  registered  (to  0.3  pixel) 
using  8  tie-points. 


6.  RESULTS 

Figures  2b  shows  a  row  R2i  (specifically  the  seventh  band  or  k=9.096  microns)  from  the  chronochrome  algorithm 
as  well  as  the  appropriate  row  taken  from  approximations  to  the  cross  covariance  matrix  including  the  “average 
CV”,  “weighted  CV”,  “diagonal”,  and  “target  CV”.  An  examination  of  all  of  the  rows  and  columns  (not  only  the 
row  shown  in  Figure  2b)  of  the  cross  covariance  matrix,  finds  that  the  “average  CV”,  and  “weighted  CV”  most 
closely  resemble  the  values  derived  using  chronochrome,  over  the  entire  wavelength  or  band. 

The  man-made  targets  were  distributed  in  the  viewing  area  and  are  designated  as  target  type  #1,  target  type  #2,  and 
target  type  #3.  The  computed  signal  to  clutter  ratio  (SCR)  of  the  target  types  #1,  #3  signature  following 
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Wave  Length  (microns) 

Figure  2a.  The  displayed  cross  covariance  profiles  are  individual  rows  taken  from  the 
cross  covariance  matrix.  The  labels  denote  the  cross  covariance  (chronochrome),  Unit 
CV,  auto  covariance  for  the  Background  Bkg-Bkg  CV,  Target  Tgt-Tgt  CV,  Bkg-Bkg  CV. 
In  all  the  displayed  profiles  show  a  particular  row  (Band  7,  or  wavelength  9.096 
microns).  Arrow  shows  reference  band  7  or  wavelength  9.096  microns. 


■\\avt  Length  (maws) 


Figure  2b.  Approximations  to  cross  covariance  profiles  are  the  cross  covariance 
(chronochrome),  Average  CV,  Weighted  CV,  Bkg  CV  (Diagonal).  In  all  the 
displayed  profiles  show  a  particular  row  (Band  7,  or  wavelength  9.096  microns). 
Arrow  shows  reference  band  7  or  wavelength  9.096  microns. 
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transformation  by  the  labeled  algorithms  is  displayed  in  Figures  3  and  4.  The  SCR  in  this  study  (see  Equation  1 1  in 
[3])  is  computed  from  the  ratio  of  the  target  contrast  relative  to  the  background  variance.  The  SCR  calculation  treats 
the  “in-scene”  signature  (L  2-x  2>mea., )  as  the  target  signature  and  the  transformed  signature  vector  (L2itrans-x  2,mean)  is 
used  within  a  Weiner  Filter  projection  [2,3]-  SCR  from  unaffected  (raw,  unconverted)  spectra  are  also  displayed  to 
provide  a  reference  to  the  maximum  SCR  and  labeled  as  “in-scene  limit”  (SCR  Ref_Max  )•  The  “in-scene”  target 
spectrum  L2  is  taken  from  the  Mission  2  image  cube.  The  “hazy  day  limit”  is  the  SCR  computed  using  the 
uncorrected  target  spectrum  Lj  taken  from  the  Mission  1  or  “hazy  day”  image  cube.  From  the  figures,  it  can  be  seen 
that  algorithms  which  more  closely  match  the  chronochrome  predictor  (“weighted  CV”,  “average  CV”  see  figure 
2b)  achieve  larger  computed  SCR  relative  to  those  that  depart  from  the  chronochrome  algorithm  (figures  3a,  4a). 
Similarly,  figures  3b,  4b  show  the  SCR  from  algorithms  that  scale  and  offset  spectra  of  features  in  the  clutter  (such 
as  roads,  trees,  blackbodies,  clutter  mean)  to  transform  target  spectra  (see  Section  4).  Algorithms  that  only  scale  or 
offset  individual  spectra  (figures  3b, 4b),  show  lower  SCR  relative  to  those  that  use  statistics  that  characterize  the 
entire  clutter  in  the  overlap  region  (figures  3a,  4a).  Transforms  that  use  offset  to  correct  target  signatures  show  very 
similar  behavior  to  the  behavior  shown  using  the  scaling  approach  (figures  3b,  4b).  Although  only  two  types  of 
target  spectrum  (Target  #1,  Target  #3)  are  shown,  calculations  (again,  not  shown  due  to  manuscript  length 
limitations)  demonstrate  that  transformations  of  the  other  target  spectra  (Target  #2)  show  the  same  trend  displayed 
in  figures  3  and  4.  Specifically,  all  targets  (Target  #1,#2,  #3)  achieve  larger  SCR  using  clutter  statistics  (discussed  in 
Section  3)  relative  to  those  that  only  use  individual  spectra  (see  Section  4). 

This  study  also  tested  the  stability  of  the  transformation  algorithm  s.  As  a  starting  point,  a  limited,  randomly 
distributed  number  of  pixels,  in  the  target  (“In-Scene”)  image  cube  were  used  in  the  calculations.  The  coverage 
ranged  from  0.1%  (or  10  pixels)  up  to  100%  (100,000  pixels).  SCR  as  a  function  of  pixel  number  for 
approximations  to  the  chronochrome  matrix  are  shown  figure  5a.  The  reduction  in  the  number  of  pixels  (and 
coverage)  diminishes  sampling  of  the  clutter  (figure  5a).  The  poorer  sampling  degrades  the  SCR  for  a  given 
algorithm.  Using  fewer  sampling  pixels  also  increases  the  statistical  uncertainty  (each  of  the  random  sample  were 
run  four  times)  (figure  5a).  For  coverages  exceeding  5%  and  500  pixels,  the  response  appears  insensitive  to  pixel 
number.  To  avoid  problems  with  singularities,  inverted  covariance  dependent  algorithms  (i.e.  chronochrome) 
sampled  a  minimum  of  50  pixels  (exceeding  30  or  the  number  of  wavelength  bands).  Tested  algorithms  that  use  the 
“In-scene”  auto-covariance  matrix  (“average  CV”,  “weighted  CV”)  are  most  affected  by  the  reduced  sampling. 
Other  algorithms  that  depend  only  on  the  standard  deviation  or  means  (“diagonal”)  are  far  less  sensitive  to  the 
number  of  sampled  pixels  and  coverage  and  have  lower  statistical  errors.  However,  these  more  stable  algorithms 
also  yield  lower  SCR  relative  to  approximations  based  on  chronochrome.  SCR  Rer_Max  and  “hazy  day  limit”  SCR  are 
also  shown.  Algorithms  that  only  scale  individual  spectra  (figure  5b),  show  lower  SCR  but  more  stable  SCR  for 
reduced  number  of  pixels  in  the  overlap  region  relative  to  those  that  use  statistics  that  characterize  the  entire  clutter 
in  the  overlap  region  (figure  5a).  Again,  transforms  that  use  offset  to  correct  target  signatures  show  very  similar 
behavior  to  the  behavior  shown  using  the  scaling  technique.  Although  only  one  type  of  target  spectra  is  shown, 
additional  calculations  demonstrate  that  transforms  of  other  types  of  targets  show  the  same  trends  displayed  in 
figures  5a  and  5b.  That  is,  less  stable  SCR  using  fewer  number  of  pixels  in  the  overlap  region,  are  achieved  for  all 
target  types  (Targets  #1,#2,#3)  using  clutter  statistics  (Section  3)  relative  to  those  that  only  use  individual  spectra 
(Section  4). 

A  false  colored  image  showing  clutter  and  the  targets  types  #1,  #2,  #3  is  shown  in  Figure  6a.  Output  from  an 
anomaly  search  [17]  applied  to  the  same  “In-scene”  image  cube  is  shown  in  Figure  6b.  Strong  signals  from  target 
types  #1,  #2,  #3  are  detected  as  well  as  false  alarms  from  the  clutter.  Figure  6c  shows  output  from  the  matched  filter 
algorithm  [18]  applied  to  the  “In-scene”  image  cube  using  the  spectra  from  the  transformed  (“weighted  CV” 
sampled  with  1000  pixels  or  10%  coverage)  Target  #1  material.  All  objects  associated  with  target  type  #1  are 
detected  as  well  as  a  small  signal  from  target  type  #3  as  shown  in  Figure  6c.  Figure  6c  shows  no  signal  from  target 
type  #2.  Ground  truth  reveals  that  the  target  type  #3  is  permeable  material  that  covered  target  type  #1,  and  so  that 
target  type  #1  signature  leaks  through  the  target  type  #3  material. 

ROC  curves  (Figures  7a,  7b)  (probability  of  target  detection  versus  false  alarm  rates)  assess  the  ability  of 
transformed  spectra  to  discriminate  targets  from  clutter  within  the  matched  filter  algorithm.  Positive  target  detection 
at  a  given  pixel  is  identified  when  the  algorithm  output  exceeds  a  threshold  value  and  the  pixel  resides  inside  a 
target.  The  targets  are  identified  as  aggregated  objects.  The  targets  in  this  analysis  included  one  (target  type  #3) 
which  actually  showed  remnants  of  Target  #1.  In  contrast,  false  alarms  are  recorded  for  pixel  values  that  exceed  a 
threshold  but  also  reside  outside  the  identified  target.  Figure  7a  shows  the  ROC  curves  for  matched  filters  using 
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TargetType#!  SCR 


Figure  3a  Chart  showing  SCR  of  Target  #1  transformed  via  algorithms  labeled  as 
Chronochrome,  Bkg  CV  (Diagonal),  Tgt  CV,  Wtd  CV,  Ave.  CV.  Limits  labeled  as 
In-scene  and  Hazy-Day.  SCR  used  cluttered  data  from  In-scene  image  set. 


Figure  3b  Chart  showing  SCR  of  Target  #1  via  transformations  by  algorithms 
using  the  offset,  and  scaling  approaches.  Labeled  algorithms  as  tree,  sandy  road, 
ISAC.  SCR  limits  indicated  by  In-scene,  Hazy-day.  SCR  used  In-Scene  image 
set. 
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Target  Type  #3  SCR 


Figure  4a  Chart  showing  SCR  for  Target  #3  using  algorithms  labeled  as 
Chronochrome,  Diagonal,  Target  CV,  Weighted  CV, Average  CV.  Limits 
labeled  as  In-scene  and  Hazy  day.  SCR  computed  using  In-Scene  image 
set. 


Target  #3,  SCR 


Figure  4b  Chart  showing  SCR  for  Target  #3  following  transformations  by  algorithms  using  the 
offset,  and  scaling  approaches.  These  transforms  labeled  as  tree,  sandy  road,  ISAC.  Limits 
labeled  as  In-scene  and  Hazy  day.  SCR  used  clutter  from  In-Scene  image  set. 
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Figure  5a  SCR  as  a  function  of  number  of  randomly  sampled  pixels  in  the  overlap 
region.  Spectral  libraries  following  Chronochrome,  Weighted  CV,  Average  CV, 
Target  CV,  Diagonal  transforms  of  Target  #1  spectra.  SCR  calculation  uses  “In¬ 
scene”  (or  target)  image  set.  Uncorrected  “In-scene”  and  “Hazy  Day”  spectra  of 
Target  #1  also  displayed.  Statistical  error  bars  are  shown. 
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Figure  5b  SCR  as  a  function  of  number  of  randomly  sampled 
pixels  in  the  overlap  region.  Spectral  libraries  using  Scaling 
approach  and  substituting  Mean  values,  and  averages  of  Trees, 
Sandy  Road,,  Blackbody  from  ISAC  spectra  (the  latter 
corresponds  to  VANTAGE).  SCR  calculation  uses  “In-scene” 
(or  target)  image  set.  Uncorrected  “In-scene”  and  “Hazy  Day” 
spectra  of  Target  #1  also  displayed.  Statistical  error  bars  are 
shown.  Offset  approach  yields  similar  data. 
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target  signatures  from  chronochrome,  “average  CV”,  “diagonal”,  the  uncorrected  “hazy  day”  target  signature,  and 
the  anomaly  search.  The  chronochrome,  “average  CV”,  and  “weighted  CV”  (but  not  shown  in  Figure  7a) 
transformed  signatures  for  matched  niter  searches  can  generate  100%  target  detection  with  zero  false  alarms. 
Matched  filter  algorithm  using  transforms  that  most  faithfully  resemble  the  chronochrome  transform  (“weighted 
CV”,  “average  CV”)  yield  large  SCR  for  all  target  materials,  and  generate  higher  detection  probabilities  (for  a  fixed 
false  alarm  rate).  Figure  7b  shows  that  reducing  the  pixel  number  in  the  transformation  (specifically  the  “weighted 
CV”,  but  is  valid  for  all  other  transforms)  can  diminish  target  detection  as  well  as  SCR.  As  suggested  by  the  studies 
of  SCR  (figure  5a),  excellent  ROC  curve  performance  can  be  achieved  with  relatively  few  pixels. 


7.  DISCUSSION 

The  chronochrome  methodology  to  transform  target  signatures  yields  an  excellent  response  as  expressed  in  the  ROC 
curves  for  matched  filter  applications  in  this  analysis  and  other  studies  [2-3].  In  addition,  this  technique  generates 
large  SCR  in  the  particular  scenarios  under  study.  Chronochrome  requires  a  pixel  to  pixel  comparison  and  uses  tie- 
points  to  help  register  two  sets  of  spectral  images  derived  from  multiple  flight  missions.  Registering  independent 
image  cubes  is  often  time  and  computationally  consuming  and  requires  substantial  intervention  by  an  image  analyst. 
For  the  scenarios  examined  in  this  study,  the  “diagonal”,  “target  CV”,  “weighted  CV”,  and  “average  CV” 
approximations  to  the  chronochrome  algorithm  simultaneously  provide  faithful  spectral  library  conversions  for 
multi -temporal  monitoring  projects,  and  accurately  detect  targets  amid  the  clutter  in  matched  filter  searches.  In 
addition,  the  “diagonal”,  “target  CV”,  “weighted  CV”,  and  “average  CV”  only  require  identification  and  association 
of  overlapping  areas  but  do  not  require  precise  registration.  Further,  for  the  scenarios  considered  in  this  study,  these 
approximations  are  robust,  generating  valid  transformations  using  relatively  few  pixels  and  low  overlap  coverages. 
The  relative  ability  of  the  mathematical  transforms  to  precisely  convert  the  spectra  is  independent  of  the  target 
material. 

Algorithms  that  use  spectral  libraries  of  common  features  in  the  image  cubes  or  rely  on  the  image  cube  means 
generate  lower  SCR  relative  to  transforms  that  use  covariance  matrices  from  the  image  cubes  (compare  figures  4a 
and  4b).  However,  transforms  based  on  spectra  of  features  found  by  an  image  analyst,  extracted  autonomously  using 
the  ISAC  procedure,  and/or  using  image  cube  means,  are  far  less  dependent  on  the  number  of  pixels  sampled  or 
areal  coverage  (figure  5).  Under  low  sampling  conditions  (<500  pixels,  <0.5%  coverage),  these  algorithms  exceed 
covariance  based  transforms.  Choice  of  particular  features  (roads,  trees,  blackbodies,  image  means)  did  not  affect 
algorithm  performance  (as  measured  through  SCR).  In  addition,  selecting  offset  or  scaling  (of  spectral  features)  to 
correct  target  spectra  does  not  significantly  affect  algorithm  performance.  The  scaling  or  offset-based  algorithms  are 
computationally  simple  and  fast  because  they  did  not  require  computation  of  covariance  matrices. 

For  this  particular  LWIR  data  set,  the  “weighted  CV”  and  “average  CV”  transforms  perform  better  than  the 
“diagonal”  and  “target  CV”  transforms  as  indicated  by  SCR  and  the  ROC  curves.  Unlike  “diagonal”  and  “target 
CV”  transforms,  the  cross  covariance  approximated  by  the  “weighted  CV”  and  “average  CV”  transforms  follow  the 
same  symmetry  under  interchange  of  missions  1  and  2  as  the  chronochrome  algorithm  (see  Table  1).  The  symmetry 
behavior  of  the  cross  covariance  matrix  may  be  an  important  criterion  for  selecting  optimal  transforms.  Other 
candidate  algorithms  were  tested  (but  not  discussed  in  this  paper)  such  as  R2\j^O\jG2\  which  follows  the 
chronochrome  behavior  under  interchange  of  missions  1  and  2,  but  suffers  from  reduced  SCR  and  low  target 
detection  probability. 

Due  to  varying  conditions  in  other  investigations,  this  study  does  not  definitively  endorse  a  particular  spectral 
signature  transform.  For  example,  the  image  sets  1  and  2  discussed  in  this  paper  used  calibrated,  flat-fielded  image 
sets.  Due  to  the  use  of  calibrated  image  sets  in  this  project,  Oj  -o2  and  therefore  the  average  CV  offers  an  accurate, 
robust  spectral  signature  (see  figures  2b,  3a,  4a) .  However,  the  average  CV  may  not  provide  an  accurate  signature 
transform  for  other  image  cubes  that  use  uncalibrated  image  sets,  or  use  image  sets  requiring  gain  corrections  where 
Oi  differs  substantially  from  c2  for  all  bands.  Differing  conditions  that  prevail  in  other  works  can  change  the  relative 
merits  of  the  signature  transforms  proposed  in  this  study. 

Matched  filter  searches  can  specifically  identify  targets.  However,  matched  filter  algorithm  searches  are  rarely  used 
to  find  man-made  targets  within  cluttered  backgrounds  due  to  unstable  spectral  signatures.  Most  studies  apply 
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Target#!  Target#! 


Target  #2 


Figure  6a.  False  color  image  of 
overlap  region 

showing  three  types  of  targets. 


Target  #3 


Figure  6b.  Anomaly 
output.  Targets  1,2,3 
detected  as  well  as  false 
alarms. 
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Figure  6c.  Matched  filter  using 
Weighted  CV  with  unregistered 
1000  points  transform  of  Target  #1, 
Note  detection  of  Target  #3,  which 
includes  obscured  Target  #1. 
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Figure  7b  ROC  curves  for  matched  filter  algorithm  using  the  weighted 
CV  transformed  (10,  50,  100,  all  pixels  in  the  overlap  region))  spectral 
signatures  of  “Hazy  Day”  Target  #1  spectra  applied  to  In-scene  image 
cube. 
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anomaly  search  algorithms  due  to  spectral  library  variability.  Unspecific  searches  (such  as  anomaly  algorithms)  find 
spectrally  uncharacteristic  features  in  a  scene,  but  do  not  distinguish  military  target  materials  from  man-made 
objects,  and  do  not  identify  materials  in  the  scene.  This  work  reexamined  this  state  of  affairs  by  transforming  the 
hyperspectral  signatures.  For  the  particular  situation  examined  in  this  study,  the  transformed  signatures  helped 
correctly  identify  significant  targets,  rather  than  only  recognized  non-specific  aberrant  objects. 

The  transformed  and  analyzed  spectra  were  derived  from  particular  missions  flown  on  successive  days  in  Florida 
during  the  autumn.  However,  a  more  rigorous  test  of  these  transforms  would  convert  and  compare  spectra  derived 
from  missions  flown  at  widely  separated  times  and  in  varying  seasons  and  backgrounds.  The  present  study  derives 
spectral  libraries  from  an  image  cube.  Other  applications  may  instead  depend  on  using  spectral  libraries  from 
archival  sources.  In  addition,  future  work  may  apply  these  approximation  techniques  to  visible  short  wavelength  or 
uncalibrated  data. 
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Figure  1.  Outline  of  modified  genetic  algorithm  applied  to  generating 
maximal  SCR.  Crossover,  mutation,  and  offspring  defined  so  as  to  fix  total 
number  of  bands,  but  permit  variable  number  of  bands  in  the  bins. 
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Figure  4b.  SCR  for  ”in-scene”  targets  (#1,#2,#3)  applied  to  “in-scene”  imagery 
“down  selected”  bands  for  30(1),  15(2),  10(3),  6(5),  5(6),  3(10),  2(15)  number 
(separation)  bands.  No  band  shifts. 
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Figure  5.  SCR  for  “in-scene”  targets  (#1,#2,#3)  applied  to  “in-scene”  imagery 
comparing  sets  of  5  bins  with  variable  shifts  or  displacements. 
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Figure  6a.  “Hazy  day”  targets  (#1,#2,#3)  transformed  to  “in-scene”  image  conditions 
using  the  weighted  CV  transform. SCR  for  transformed  targets  applied  to  “in-scene” 
imagery.  Transform  and  SCR  calculation  used  using  integrated  bands  for  30(1),  15(2), 
10(3),  6(5),  5(6),  3(10),  2(15)  number  (width)  bands. 
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Figure  6b.  Change  in  SCR  for  Target#  1  transformed  from”hazy  day”  to  “in-scene”  using 
Weighted  CV  using  genetic  algorithm  to  choose  the  bands  relative  to  uniform  binning. 


